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INTRODUCTIOIV 



The Objectives Development Process 
for the 1985-36 Assessment of Science 

In 1985-86, the National Assessment of Educational Pjxjgress INAKP) will 
undertake the fifth national assessment of scien'cc. Since h9G9, N/VEP 
has pronded periodic report cards for the nation, collecting and inter- 
preting infomiation about the knowledge, skills, aiid attitudes of 9-, 13-, 
and 17-yeai^old students in most of the subjects in the school cunicu- 
lum. The planning for the 1985-86 national assessment of science took 
place as public concern focused on the quality of elementaiy and 
secondary education in the United States, A number of prestigious 
reports critical of the schools sparked unprecedented public debate 
and calls for improvement across the country, 

A Nation at Risk, the report of the President 's Commission on Excel- 
lence, called for increased attention to science and for emphasis on the 
development of highei^order thinking and problem-soKing skills, Edw 
eating Americans for the 21st Century, the report of the National Science 
Board Commission on Precollege Education in Mathematics, Science, 
and Technology, stated. "We must return to the basics, but the basics' 
of the 21st century are nr* only reading, writing, and arithmetic. They 
include communication and higher problem-solving skills, and scien- 
tific and technological literacy — the thinking tools that allow us to 
understand the technoJogical worid around us. These new basics are 
needed by all students. . . " The Assessment Policy Committee, which 
governs NAEP and includes teachers, school superintendents, state 
legislators, school board .members, and representatives from business 
and industry, also called for increased emphasis on problem-soKing 
and higher-order skills in the 1985-86 assessment. 

According to the first NAEP science objectives, formulated in 1965, 
the major purpose of science education is to develop scientifically 
literate individuals. For each successive National Assessment of Sci- 
ence, objectives have been developed as a fi^amework for measuring the 
attainments in science of students in the United States at ages 9, 13, and 
17. Collectively, these objectives — revised and relined over the years — 
provide one definition of scientific literacy. The objectives for 1985-86 
build on what has gone before, taking into account recent develop- 
ments and new emphases. 

As in the past, these objectives resulted fix)m a consensus process 
involving many people. Development began with a review of the objec- 
tives from the 1976-77 assessment by 25 practicing scientists and educa- 
tors, including college teachers of science, specialists in science educa- 
tion, school science coordinators, classroom teachers, and school 
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administratoi^s tix)m aJI pails of the coiintiy. Tlw.'iv comments and 
suggestions for change weix; considercd by the Science Ijcai^iing /\ixja 
Committee (see Appendix C), which met to fomiulate the objecSixes and 
design of the 1985-86 assessment. Successive dnifts of the boGklet were 
ix;\ie\ved not only by the committee but aJso by other practitioners in 
the schools. The objectives also were reviewed by the Assessment Policy 
Committee and by a gix)up representative of the interested lay public 
not directly involved with science education. The committee consid- 
ered these renews at each of its meetings in oixler lo respond to the 
broad range of opinions, interests, and priorities concerning science 
education. 

The material that follows presents the framework and specifications 
that guided the development rf new exercises for the assessment. At the 
same time, it indicates what the Science Learning Area Committee and 
reviewers agreed is appropriate for the assessment to me«isure in sci- 
ence attainment and in attitudes towai d science. This consensus is one 
view of ihe objectives of American science education. 
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CHAPTER 1 



The Framework for Science Objectives 

A matiix in thm? dimensions— Content, Context, and Cognition— 
reprt^sents the broad objectives of science education. Exhiljil 1 pivsents 
the matrix in \isuaJ (omi, showing that each dimension is di\ided into 
major categories. Each exercise in the assessment can be classified inlo 
a cell of the matrix that matches the categoiy of content it assesses, the 
context in which it is presented, and the cognitive skill it measures. 
However, exercises cannot be de\ised fnr ex^ery cell because a few 
combinations, such as history in a persojial context, are metiningless. 
This three-dimensional framework is a departure from the two- 
dimensional one developed for the 1976-77 assessment and used again 
for the 1981-82 assessment. The concepts underlying the two frame- 
works, however, are similar enough to permit easy reclassification of 
preuously administered exercises into cells of the three-dimensional 
matrix;. Thus, it is possible to maintain continuity in reporting trends 
over time by reusing a subset of previously administered exercises in 
the new assessment. (Unlike the 1985-86 framewori; described in the 
following pages, the dimensions of the matrix used in the 1976-77 and 
1981-82 science assessments included an abbre\iated Bloom taxonomy 
and a dimension with three subdi\isions: content, processes, and 
science and society.) 



Major Categories in the Framework 

COMTEIVT 

The content dimension of the matrix includes both the body of knowl- 
edge in the traditional disciplines of science and knowledge about 
science, its nature and processes, and its histoty. The content dimen- 
sion contains six major categories: 

• Life Sciences 

• Physics 

• Chemistry* 

• Earth and Space Sciences 

• Histoiy of Science 

• Nature of Science 

For a discussion of these categories and the topics appropriate for 
assessment within them, see Chapter 2. 
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Exhibit 1 

Hmmrwork for Science Assessment Esrrrtsrs 




I. lie Phyr,ics Chem* Earih Historv Nature 
f.cences ,siry Sc. of of 

Space SL.cnce Scien^^ 



Sciences 



CONTENT 



COIVTEXT 

The context dimension of the matrix defines four types of situations for 
presenting assessment exercises: scientific, personal, societal, and 
technological. The definitions of these four categories arc: 

Scientific contejct: These exercises assess students' understanding of 
the body of knowledge of science. This categoiy includes the descrip- 
ti\'e facts, principles, conceptual schemes, models, and inquiiy skills 
needed to acquire masteiy of the disciplines and to attain an intellec- 
tual appreciation of the natural world. 

Personal mntext These exercises assess the students* knowledge of 
the ways in wtiich scientific facts and principles are useful in their 
e\'eiyday li\'es and the extent to which their decision-making is based 
on the application of science to matters related to general safety, health, 
well-being, habits, and life-style. 

Societal context: These exercises deal with the role and use of the 
content and methods of science in decision-making on societal issues 
and questions of public policy. This categoiy also includes exercises 
that deal with the impact of scientific and technological dev elopments 
on people, both indiiddually and collectively, through the management 
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or manipulation of the biological and pin'.sical worlds. Those* cxmTisos 
requirt* an und(»rstanding of the polontiaJ bonofits and or lisLs to 
individuals and to sociot>' of \arious s(:iontific: and tturhnologicuil 
endeavoi^. 

Technological context These e\eix:ises focus on the application of the 
knowledge and methods of science to commcuxrial or utilitarian pur- 
poses. Technologv, which is both the process of dexelopment and the 
products of that de\'(?lopment, ix^lios on concepts fixjm science and 
mathematics to create new products and procedure's. It includes tools. 
de\ic(?s, and tc?chniquc?s that can ha\'o consid(>rable influence? upon 
indi\iduals and the en\ironments in which the\' live. E.xamples of the 
technology area include biotechnology, food production, medical caix), 
enei^' production and consumption, transportation, communication, 
and nuclear power. Tools and de\ices include such things as wind- 
mills, micmscopes, .vrav machines, tele\ision. computei^, and nuc:lear 
submarines. 

COGNITION 

The learning Area Committee designed the cognition dimension of the 
matrix so that exercises could be classified according to the cogniti\e 
processes required to deal with science content at different lex'els of 
complexity. The committee defined three generic categories — knows, 
uses, and integrates — and based the following descriptions of these 
categories on cogniti\'e theory that defines three types of knowledge, 
each of which has a different function in problem-soKing. 

tenon's: These exercises test primarily factual knowledge. Successful 
performance depends on the ability to recall specific facts, concepts, 
principles, and methods of science; to show familiarity with scientific 
terminology; to recognize these basic ideas in a different context; and to 
Jranslate information into other words or another format. This category 
generally inwK'es a one-step cogniti\'e process. 

Uses: These exercises test the ability to combine factual knowledge with 
mles, formulas, and algorithms for a specified purpose. Successful 
performance depends on the ability to apply basic scientific facts and 
principles to concrete and/or unfamiliar situations; to interpret infoi^ 
mation or data using the basic ideas of the natu *al sciences; and to 
recognize relationships of concepts, facts, and pnnciples to phenom- 
ena observed and data collected. This category generally invoK'es a 
two-step cogniti\'e process. 

Illiterates: These exercises test the ability to oi^anize the component 
processes of problem sohing and learning for the attainment of more 
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complex goals. Successful perfoiTnance depends on the ability to ana- 
lyze a problem in a manner consistent uitb the body of scientific 
concepts and principles, to organize a series of logical ,stef)s, to draw 
conclusions on the basis oi available data, to evaluate the best pmce- 
dure under specified conditions, and to employ other higlier-order 
skills needed for reaching the solution to a problem. 

This category generally involves multi-step cognitive processes. In 
particular, it requires such mental processes as generalizing: Inpot he- 
sizing: interpolating and extrapolating; reasoning by anidogs'. induction 
and deduction; and synthesizing and modeling. 

Specifications for Assessment Exercises 

A national assessment of science can i^over only a small sample of the 
domain included in science education throughout the school years. 
Therefore, the committee needed to consider how much weight to give 
to each of the major categories in the matrix. Weights were assigned 
separately to each age level because the emphases and expectations 
appropriate for 9-, 13-. and 17-year-old students are different. 

The committee assigned an approximate peixentage of the assess- 
ment to each major categoiry for each of the three dimensions, in order 
to define how students' knowledge of science should be sampled and 
to guide exercise development. The percentages were selected taking 
into account information about what the school curriculum typically 
includes, and a consensus about utiat the focus and outcomes of 
science education should be. 

In the context category, the committee decided on a cwnbined 
percentage for personal, societal, and technological exercises rather 
than specific percentages for each, because many exercises will involve 
both pjersonal and technological or societal and technological contexts. 
For 9-yeaiM)lds, personal contexts will probably dominate, with more 
emphasis on societal and technological contexts at the older age levels. 

In the cognition dimension, the committee assigned the same j>ei^ 
centages to all three ages, with the understanding that what is expected 
of 9-year-olds in the "integrates" category (v\Wch calls for multi-step 
processes and higher-order skills) will be s-ignificantJy different fixim 
what is expected of older students. Since it is not possible to know 
precisely w^at knowledge and processes any indi\adual student will 
apply to a given exercise, the classification of the exercises as knows ' 
or uses" or even integrates" was based on informed judgment about 
the factual knowledge and cognith'e processes that an average student 
in the tai^et ix>pulation is most likely to apply to obtain the correct 
answer. For example, for one student, answering a particular question 




may simply involve knowing the factual infomiation needed. /\nother 
who does not haxe that specific information may arrive at the conx3ct 
answer by a mental process that involves different but related informa- 
tion. FA'eryone who classified exercises needed to consider the age of 
the intended population as well as its probable academic experience. 
An exercise can 5)e in the "knows" category for older students and in the 
"integrates" category for younger ones, because what older students 
may know as a fact younger students probably can arrive at only by 
multi-step reasoning. 

The percentages assigned are shown in the following tables. 

Table 1 

Content: Approximate Percentages 



Categorv- 


9-ycar-oIds 


13-vear-oIds 


17-year-old.s 


life Sciences 


35% 


25% 


25% 


Physics 


15 


15 


20 


Chemisir\' 


10 


15 


20 


Earth and Space Sciences. . . 


20 


20 


15 


Hisiorv of Science 


5 


10 


5 


Nature of Science 


15 


15 


15 




100 


100 


100 




Table 2 






Context: Approsiniate Percentages 




Categorv' 


9-vear-olds 


13-vear-olds 


17-vear-oIds 


Scientific 


50%. 


55% 


60% 


Personal "\ 








Societal I 


50 


45 


40 


Technological J 










Too 


100 


Too 




Tables 






Cognition: Approsiniate Percentages 





Categorv 9-year-olds 13-year-olds 17-year-olds 

Knows 40% 4(yr^ 40^^ 

"^ses 30 30 30 

Integrates jjo 30 30 

100 100 Too 
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Other Aspects of the Assessment 

In addition to the assessment of students knowledge of science, the 
assessment will collect information tcom students on their back- 
grounds in science, their attitudes toward science, and their scientific 
experiences, both in school and outside, NAEP will also ask teachers 
and school administrators about such things as science curriculum, 
laboratory facilities, time devoted to science, backgrounds of teachers, 
and teaching methods. The collection of these data has two important 
purposes: to report on these subjects to the public, which is concerned 
alK>ut the status of science education, and to improve the usefulness of 
the assessment results by studying and reporting on the relationship of 
these factors to science achie\'ement. 

Since self-report questions on attitudes, values, and experiences do 
not fit into the matrix, the committee cons? vfered them separately It 
identified seven categories of questic ns for students: attitudes toward 
science classes, career and education intentions, socioscicntific 
responsibility, science as a personal tool, value of science, societal 
issues, and experiences in science. This portion of the assessment is 
described in more detail in Chapter 3. 
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CHAPTERS 



Science Content 

This chapter describes the major categories of the content dimension 
in more detail by subdinding them. 

The content dimension of the matrix represents the facts, concepts, 
conceptual schemes, inquiry skills, and other aspects of science con- 
tent subsumed in the major categories. Since the amount of material in 
this area is so extensive, the Learning Area Committee diuded each of 
the major categories into a set of nanwver, although still broad, topics 
appropriate for inclusion in the assessment. Some of the topics in the 
lists that follow are not appropriate for 9-year-olds; a few are appropri- 
ate only for 17-year-olds. 

The first four major content categories— Life Sciences, Fh\'sics, 
ChemistiA% Earth and Space Sciences— represent the content of the 
traditional scientific disciplines. Each of the broad topics within each of 
these major categories has been further subdixided into a list of impor- 
tant concepts or subtopics, to guide the writing and selection of exer- 
cises. These lists appear as Appendix A, with indication of the age 
levells) for which each item is consideix?d appropriate. In dexeloping 
these lists, the committee recognized that manv topics cross discipline 
lines. 

History of Science is a new area for the assessment. The committee 
considered it important for students to know and understand some- 
thing about how scientific ideas and theories de\'elop and change o\'er 
time, about how society has influenced scientific dex'elopmcnt, and 
how dev elopments in science have alfectcd society, and about some of 
the outstanding figures in science. The ii3cth categorv, the Nature of 
Science, is Designed to measure students' understanding of the charac- 
teristics and methods of scientific inquiry" and their ability to apply the 
processes of science to the solution of problems. 
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These six major categories ot science c ontent contain the following 



• Ufe Sciences 

— Cellular and molecular biologv* 

— Enei^' transfomiations iphotosynth(\sis and (H^liular 

metabolism) 

— Stnictuix^ and functions of organisms ipmtists. plants. aniniaJsi 
— Uivei^ity of organisms (classificalioni 
— Genetics and dexelopmcMit 
— Evolution 
— Ecologv' 

— Beha\ior 

• Phinics 

— Mechanics (motion, forces, principles of conseivation> 
— Waves and optics 

— Elect ric:it>' and magnetism 

— Modem physics (atomic, nucleai\ rclali\it\') 

— Heat and kinetic theory 

• Chemistry^ 

— Structure of matter (nuclear, atomic, and molecular) 

— Periodic classification 

— States of matter and nature of solutions 

— Reactions of matter (chemical transfomiationsi 

— Stoichiometiy 

• Earth and Space Sciences 
— The Earth's histoiy 

— Materials of the Earth 

— Agents and processes of change in the HaUh's surface 

— Earth's atmosphere and weather 

— Describing and measuring time and location 
— Tile oceans 

— Tlie solar system, galaxies, and the universe 



topics: 
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• History of Science 

— Dewlopmoiit of scientific ideas 

— Historv' of science — society interactions 

— Pioneers in science 

• \ature of Science 

— Processes of science 
— /Assumptions of science 

— Characteristics and limitations of scientific methods 

— Ethics in science 

Knowledge of the processes of science and the abilitA' to apply them 
is basic to the attainment of scientific literacv'. The processes of scien- 
tific inquiry include acti\ities such as observing, measuring, experi- 
menting, communicating, as well as mental processes such as intei^ 
preting data: generdizing: inteqjolating, Inpothesizing: masoning hv 
anaJog\\ by metaphor, by induction and deduction: svntliesizing: and 
ir.odeling. 

The mental, or cognitix e, processes essential to successftil scientific 
inquirv' are not unique to science. They overlap with the generic cate- 
gories in the cognition dimension of the matrix, especially with the 
"integrates" category, which calls for multi-step processes and higher- 
order skills. The committee distinguished two t\pes of exercises for 
classification. Exercises that focus solely on knowledge of science pro- 
cesses and their applitrarion were c/assified under Nature of Science 
and the comparable cognition category. Exercises that require the 
student to recall and apply factual knowledge from one of the disci- 
plines of science were classified under the particular discipline (Life 
Sciences, Physics, Chemistrv, Earth and Space Sciences) and the appro- 
priate cognition category. 
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CHAPTERS 



Attitudes; ValueS; and Experience 

The collection and reporting of information about students' attitudes 
and values with respect to science and scientific endeavors arc impor- 
tant parts of the assessment. Because it is inappropriate to make state- 
ments about how people should feel or think about a subject, questions 
in these areas have no right or wrong answers. Rather, NAEP regards its 
attitudinal questions as primarily investigative and the results descrip- 
ti\'e of the attitudes and values students hold. The assessment monitors 
trends by repeating some questions fixim prenous assessments and 
reporting how students' attitudes have changed over the years. 

This component of the assessment includes seven categories of 
questions for self-reporting by students, Descriptiorts of the categories 
follows 

Attitudes toH'ard science classes: Attitudes assessed in these ques- 
tions are all related to classroom experiences. NAEP has typically used 
this category to obtain answers to such questions as: Do students 
perceive science classes to be enjoyable and useful? Do students believe 
their teachers enjoy science, know a lot about it, make it interesting? 
How do students feel about different types of acti\ities in science 
classes? Why do they feel the way they do? 

Career and education intentions: Questions in this category address 
students' attitudes and intentions or expectations regarding further 
study of science and the possibility of entering careers in science- 
related fields. Since the attitudes and intentions of students today may 
alfect the numbers of workers in science, engineering, and related fields 
tomorrow, it is important to find out what attitudes and expectations 
students hold, and why. 

Socioscientific responsibiHiy: The intent of questions in this category 
is to ascertain whether students believe that societal problems related 
to science affect them personally and whether they believe that they 
themselves can contribute to the solution of such problems. For exam- 
ple, the intent of some questions is to find out if students believe that 
current problems in energy, food pixjduction, or overpopulation touch 
their lix-es. The assessment asks students whether they believe they can 
do something personally to help with a specific problem such as energy 
shortage. Other questions deal with such things as whether or not 
students are willing to help solve societal problems. 

Science as a personal twb Questions in this category assess students' 
opinions about the utility of scientific knowledge and the skills and 
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processes of scientific investigation in their daily li\'es. Some of these 
questions try to ascertain whether students belie\'e that what they learn 
in science classes is useful for acti\ities outside school, and whether 
they use this knoniedge. 

VaiueofSd&ice: The priman' object of questions in this categoiy is to 
find out whether students have confidence in science and \'alue scien- 
tific investigation as a beneficial acti\ity. This inquiry addresses such 
questions as: Do students believe applications of science can help solve 
world problems? Has use of science impro\'ed the quality of life? This 
category also includes students' attitudes toward the conduct and 
support of research \n basic and applied sc:ientific fields and their 
opinions on the extent to which science and scientific acti\ities should 
be controlled by the go\'emment or oCher social institutions, 

SfHnetal Issues: A major purpose of questions in this categoiy is to 
ascertain students' opinions and attitudes about important and contro- 
\'ersia] scientific research directions and developr^ents that could have 
an impact on society. Questions also seek studc ;* opinions on the 
relative value and importance of disparate researcn and development 
thrusts that may be in competition for limited financial support. It is 
important to determine the older students' opinions on cruical societal 
issues and any shifts in their opinions over the years, A scientifically 
literate population should be able to participate in decision-making on 
such issues and be aware of the potential risks and gains in new 
research. (Questions in this categoiy do not apply to ni. ic-year-olds.) 

Experiences in Sdemx: One intent of questions in this categoiy is to 
assess students' experiences in science-related activities, both in 
school and out. The inclusion of questions that measure the extent of 
students' extracurricular science activities provides some indication of 
whether or not they value exploring science as an intellectual exercise. 
The second intent is to determine the extent to which students receive 
opportunities for observations of the natural world and for hands-on 
laboratoiy experiences. 
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APPENDIX A 



Concepte Appropriate for the 1985-86 Assessment 

Recognizing that the topics listed in Chapter 2 under each of the 
science disciplines were still \m' broad, the Learning Ai'ea Committee 
identified specific subtopics and concepts within each topic to guide 
the dev elopment of exercises for the assessment. The committee did 
not intend the follouing lists to be complete or definitive or to imply 
that any curriculum should include all the topics. The development of 
the Ibils followed the usual NAEP consensus procedure, under which a 
brt)ad spectrum of reviewers commented on draft lists of science topics 
and on their appropriateness for students of different age:;. 

Because not all subtopics and concepts are appropriate for all age 
levels, the lists use a dot (•) in the column under a particular age to 
indicate that some aspect of that subtopic or concept could be a 
potential source of exercises for that age level. A blank indicates that the 
particular subtopic or concept is not appropriate for that age group. 

Given time and other limitations, the assessment cannot include 
exercises on all the appropriate subtopics. The final selection of exer- 
cises for the assessment required the careful balancing of a number of 
requirements: the need to repeat enough exercises fixjm previous 
assessments to be able to report on changes over time; the need to meet 
the distribution specifications with respect to content, context, and 
cognition; and the need to offer exercises over awide range of difficulty. 
Within these constraints, the choice among exercises was based on 
professional judgments with respect to the quality of individual exer- 
cises and the centrality of what each measures. 

TOPICS IN UFE SCIENCES 

9 13 17 

Cellular and Molecular Biolog}' 

Cellular theory of life • « 

Methods for studying cells • # 

Plant and animal cells • • 

Cell structure and function • # 

Life as a chemical process • « 

Structure and function of basic groups of 

biochemical compounds • • 
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Enzyrnes, hormones, and \itaniins as regulators of 
life processes 

Structure and function of Rj\A and DNA 

Translation of genetic information from genes to 
protein formation 

Energy' Transformations 

Importance of energy to lifii • 

Pood as the source of biological enei^ • 

Major energy reactions in liung things, photosyn- 
thesis and cellular metabolism 

Biological energy as the making and breaking of 
chemical bonds 

Structure and Function of Organisms 
(Protists, Plants, Animals) 

Living and nonliving things • 

Interdependences wiihin living things — 

oi^anisms as systems • 

Hierarchy of structure • nd function (from mole- 
cules to ecosystem!^ » • 

Equilibrium in living things (homeostasis) 

Structural features of plants # 

Structural features of animals • 

Structure and function of body systems (micro- 

organis.ns, plants, animals, human) • 

Good health ^rtices « 

Germ theory of disease « 

Diversity of Organisms ( Classification) 

Major divisions of biology — botany, zoology, etc • 
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Calegorie?; of li\ing ihin^'^s — kingdom, phylum, etc. . • • 

Classification schemes — structural and/or 

e\'olutionarv' relationships • • 

Taxonomy of major groups (microorganisms, 

protists, plant?;, animals) • 

Genetics and Development 

Reproduction as the lijndamental biological 

process that prQ\ides for the continuance of life • • • 

Inherited characteristics as the endowments of 

eveiA' li\ing orgfinism that comes into the world • • • 

Relationship between inherited traits and physical 

appearance • • • 

Relationship between proteins and inherited traits • 

Gene theoiy of heredity (chromosomes, genes, DNA) • • 

Strategies of reproduction — asexual and sexual . . . . • • • 

The process of meiosis in the life cy cle of sexual 

reproducers • 

Elements of Mendelian frenetics • • 

Inheritance of human traits • • • 

Inheritance of human hereditary diseases • • 

Plant and animal life cycles • • • 

Human life cycle • • • 

Growth and repair as fundamental acti\ities of 

li\ing things • • • 

Cell di\ision as the essential mechanism of growth 

and development • • 

Contemporary issues — genetic engineering, new 
reproductive technologies (e.g. IVF), genetic 
coimseling, etc • • 



Emlution 



9 



13 



Exijlution of the earth and of life as the result of 
natural forces 

Structural and functional changes in li\ing things 
as responses to changes in physical emiron- 
ment5 ^ 

Adaptation as the chief means of survival in living 
things 

Origins of nevv types of organisms through vaiia- 
tions in previously living organisms 

Progression from simple to comple^x organisms on 
an evolutionary continuum 

Extinction ab an important part of evolution 

Historical perspectives (Darvvin, Lamarck, etc.) 

Evidences for evolution (fossils, geological records, 
comparative studies etc.) 

Nature of scientific proo/as applied to evolution . . . 

Theories related to the origin of life 

Theories of mechanisms that bring about evolution- 
ary changes (natural selection, plate tectonics, 
etc.) 

Adaptive advantages of biological symmetry (radial, 
spherical, bilateral) ! 

£(Co/ogy 

Interdependencies in living systems (populations, 
communities, ecosystems, biomes) 

Energy flow through food chains (decomposers, 
producers, consumers) 

Balanced ecosystems and long-term stability 

Environments of living things as continuouf.lv 

changing * 
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Essential requimnents for life — food, ee^Hain 
temperature conditions , moisture, light and 
oxygen • 

Biogeochemical cx^cles icari)on dio\ide-ox\'gen. 
nitrogen, etc.) 

Competition • 

Importance of conservation and the protection of 
the emironment (wildlife, naturaJ i-csouitcs, 
wilderness) • 

Importance to humans of microorganisms, plants, 
and animals • 

Protectiv e adaptations (mimicr>', protective color- 

ationr etc.) • 

Prey-predator relationships • 

latitude and altitude effects on life (lilo zones) 

Effects of human activities on the environment • 

Social issues related to the environment (water 

crisis, pollution, etc.) • 

World population 

Behavior 

Response of living things to stimuli • 

Basis of behavior (genetic, physical) 

Animal behavior as a form of adaptation 

Modes of animal behavior (communication, territo- 
riality, social behavior, rr»gratory behavior, 
innate behavior, learning, navigation) • 

Animal models and human behavior 
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TOPICS Ii\ PHY SICS 



Mechanics 

Distince, force, energv' 

Lex ere, simple ^nacl^^:^trs 

Mas», volume, density 

Time, speed, relati\e motion 

Free-faJI, constant acceleration 

Principle of inertia, action-maction 

WeigJit and mass difference, \'ectoi>s 

\i?\\lon',s laws, law of gra\itation 

Conserv ation of matter 

Conservation of energ>% work, and ener^' ivlation . . 

Momentum, impulse, and conservation of 

momentum 

Rotation, torque, angular momentum 

Heat and Thermodynamics 

Phases of matter, heating, and cooling 

Temperature and temperature scales 

Phase changes, energy relations 

Chemical bonds, latent heat, thermal coefficient 

Calorinictry, first law of thermodynamics 

Heat engines, entropy, second law of thermo- 
dynamics 

Pressure, volume, and temperature relations 

Gas laws, kinetic moleculai- theory 
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(l^ai'es and Optics 

\'ibration, transmission, and t\pes ofwaseti 

Wavelength, frt*quenc\', amplitude, speed 

Reflection, refraction, diffraction, and superposition 
Snell s law, interference patterns, standing wax es. . . 

Sound and air 

Sound production, music 

UWte light and colors, shadows 

Lenses, mirrors 

Images, ray diagr2ims, lens equations 

Particle \'s. wave models for light 

Doppler effiBct, redshift 

Uectridty and Magnetism 

Electric materials, attraction and repulsion 

Chaise, protons, electrons 

Coulomb's law, fields, potential diffierence 

Electricity at home. 

Batteries, current, resistance, simple circuits 

Ohm s law, electrical pouter, electrical de\ices 

Magnetic materials. Earth's magnetism, compass . . . 

Oersted s disco\'ery, electromagnetism 

Magnetic field, currents in magnetic fields 

Electric motors, generators, AC/DC 

Generating, sending, and using electric power 

Semiconductors, transistors, and amplification 



Modem Phyvics 

Atomic structure, the four-force unhorse 

Bohr atom, quantised orf7its 

Phcitors. explanation of atomic specira 

Radioactive materials, effects of radioacti\itv 

Half-Iif??, radioacti\e decay, nuclear plants, E = mc-. . 

Fission, fusion, binding energv'" curve 

Special relativitv—basic principles 

High energy particles 

Cosmology — evidence of an expanding univei-se. . . . 

TOPICS I\ CHEMISTRY 

Structure of Matter 

Concept of dementary particles (atoms and mole- 
cules) 

Elemei:ts and compounds 

Electron shells, subshells, and ori^itals 

Radioactivity 

Matter and energy 

Ionic and covaJent bonding 

Polar and nonpolar molecules 

Macromolecules 

Periodic Classification 

Relationship between electnjnic structure and 
periodic classification 

MetaJs and nonmetaJs , 
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Families of elements 



Noble gases 

Transition elements 

Ionization potentials 

Relative electronegativities 

Atomic radii (size of atoms) 

States of Matter and Nature of Solutions 

Physical properties of solids, liquids, and gases 
(examples: ice, water, water vapor); effectives of 
temperature, pressure, \x)lume • • 

Energy changes in changes of state • • 

Kinetic and potential energy; temperature depen- 
dence of kinetic energy • 

Method of expressing concentration of solutions ... • 

Colligative properties of solutions 

Relationships between solubility and structure 

Electrical conductivity • 

Reactions of Matter 

Changes in properties of matter by chemical 

reactions • • 

Decomposition • 

Combination (burning, rusting, etc.) • • 

Energy of reactions 

Oxidation-reduction; basic concepts 

Acids and bases • 

Reversible? n factions 




Sioichiometry 

Laws of conservation of mass 

Law^ of chemical combination 

Atomic and molecular weights 

The mole concept 

Chemical equations; concepts and calculations . . . . 
Percent composition and formulas of compounds . . 

Mass-gas xtjlume relationships 

X'olume-volume relationships in gaseous reactions. . 
Enei^ relationships in chemical reactions 



TOPICS LV EARTH AlVD SPACE SCIENCES 



Earth's History 

The rock record . . 
The fossil record . 
Plate tectonics ... 

Materials of the Earth 

Earlb chemistiy . . . 

Rocks 

Minerals 

Natural resources. . 

Water 

Air 
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Agents and Processes of Change in Eairih 's Surface 

Weathering • 

Erosion • 

Cmstal movements • 

Glaciers • 

Water • 

Winds • 

Volcanism. earthquakes • 

The Earth *s Atmosphere and Weather 

/\ir and its movements • 

Water cycles • 

Climate, seasons • 

Weather • 

Describing and Measuring Time and Location 

Earth's rotation and revolution • 

Latitude and longitude 

Time and date • 

Earth's dimensions 

The Oceans 

Ocean water and its movements • 

The ocean floor • 
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The Solar System, Galaxies, and the Vnh'erse 

Design of the universe 

Stars and galaxies 

The solar system • 

The Sun « 

The Earth's Moon • 

Space exploration • 
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APPENDK B 



The exercises that fellow illustrate the classification of exercises into 
the various cells of the three-dimensional matrix designed as the frame- 
work for the science assessment. 

Each exercise is classified into one of six content areas (Life Sciences, 
PhysicSr Chemistiy, Earth and Space Sciences, History of Science, or 
Nature of Science); into one of four contexts (Scientific, Personal, Soci- 
etal, or Technological) and into one of three levels of cognition (Kno\\«, 
Uses, or Integrates). It is understood that occasionally an exercise will 
cross discipline or context lines. 

1. In which set of lj\ing things below do all four things get their food 
in a similar way? 




This exercise for 9-year-olds is classified as Life Science — Scientific 
^-Integrates. (It is an example of a quesiion that would be classified 
as integrates for 9-year-olds but not for older students.) 
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2. In the \v jstem part of the U.S., poisoned bait is sometimes used to 
kill coyotes that are attacking sheep. Some people protest this 
practice. Which of the foUov\ing is probably NOT a concern of these 
protesters? 

(A) Other animals, including some endangered species, could be 
killed by eating the poisoned bait. 

(B) Eliminating the coyote from the food web may result in 
increased numbers of mice and rabbits. 

(C) The pelts of coyotes killed by this method will not be of any 
x'alue 

( D I The wheat crop produced in the area may suffer as a result of an 
increase in first-lei^el consu>.ner3. 

This exercise is classified asli/e Sciences — Societal — Uses, suitable 
for 17-year-oIds, and possibly for students at age 13. 



Light bulbs 1 and 2 and a variable resistor R are connected to a 
battery as shown above. The resistance of R in this circuit may be 
increased or decreased. 

If the resistance of R in the diagram abo\'e is increased, how v/ill the 
brightness of light bulb 1 be affected? 

(Al It will increase. 

(B) It will decrease. 

(C) It uill remain the same. 

This exercise is classified as Physics — Scientific — Uses, suitable for 
17-y^ai^olds. 



3. 



Battery 
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4. A 100-pound woman and a 200-pound man are seated on a seesaw. 
In which of the foUowing pictures would the seesaw be balanced? 




This is an exercise suitable for 9-year-oIds, and classified as Physics 
— Scientific — Uses. 

5. Which of the following technological ad\'ances contributed most to 
increasing our knowledge of the thickness of the Earth's crust? 

(A) The diamond tipped drill bit 

(B) The orbiting space telescope 

(C) The recording seismograph 

(D) Laser surveying techniques 

This is a straight recall exercise suitable for age 13 or 17. It is class- 
ified Earth and Space Sciences — Technological — Knows. 

B. The idea that increasing concentrations of carbon dioxide in the 
atmosphere will result in an increase in the worldwide a\'erage 
atmospheric temperature is based on which of the following facts 
about carbon dioxide? 

(A) It is used by plants in photooynlhesis. 

(B) It is necessary for precip: .ition (rain) to occur. 

(C) It is produced by the respiration of plants and animals. 

ID) It is a better absorber of infrared than of ultra\1oiet radiation. 

This exercise is suitable for 17-year-olds. It is classified as Earth and 
Space Sciences — Societal — Uses. 

This is an example of an exercise that crosses both discipline and 
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context lines. There are elements of both life sciences and (chemistry 
in the exercise, as well as earth and space sciences, Altliougli one 
could also argue that the exercise is scientific, the NAEP staff judged 
that the societal implications in the question \ve»T? prcdcminant 

7, The urine of a healthy human has a pH of 735 to 7.45, Acidosis is a 
condition in v^'hich there is an abnormal increase of hydrtDgen ions. 
Urine at which of the following pH readir^gs indicates a state of 
acidosis? 

(A) 6.85 (B) 7.40 (CI 7.65 (D) 7.95 

This exercise is classified as Chemistry — Peraoual — Uses. It is suit- 
able for 17-year-olds. 
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Whe teacner tells the class, "This graph was made from watcliing an 
animal move," Thpn she asks the students to suggest what kind of 
animal was observed. Pat thinks a frog was watched as it hoppet'. 
Jean thinks the animal was a kangaroo Which of the following 
would be most helpful in determining vi^hirh of the two hyj jotheses 
was more likely to be correct? 

(A) Knowing how much time is represented by each of the flat 
portions of the graph 

(B) Knowing how much energy is represented by the space 
between two cadjacent horizontal lines 

(C) Determining whether the curved sections of the graph are 
parabc]ijc 

(D) Regraphing the data to increase its spread 

This exercise is classified as Nature of Science — Scientific — 
Integrates. It is suitable for both 13- and 17-year-olds. 
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9. By ToUowing the history of the natural sciences, we can see that 
practically e\'er>' scientific disco\'ery and idea ic built on earlfer 
discoveries and ideas. Based on this information, what is the most 
\ike\y historical order of the following de\'elopments? 

1. Fabricius describes the one-way \'alves in the \'eins that let blood 
flow only toward ihe heart. 

2. Vesalius dissects human cada\'ers and shows how to use dissec- 
tions to study human anatomy. 

3. Harvey announces his theor>' that blood circulates in the body, 
going from the heart into the arteries, then into the \'eins and 
back to the heart. 

(A) 1,3,2 

(B) 2, 1, 3 

(C) 2r 3r 1 

(Dl 3, 1,2 

This is a History of Science — Scientific — Inte^i^rates exeix:ise appro- 
priate for 17-year-olds. Although many Histon/ of Science cxeirises 
will be in the Knows category , this exe;cise has been included to 
illustrate that it is possible to assess more than straightforwaitl 
recall of facts in the history area. 

10. Studies have shown that people who smoke cigarettes have a 
greater likelihood of contracting se\'eraJ diseases. The cause and- 
efTeci relationship between smoking ind poor health is which of 
the foUowivTg? 

(Al An observation 
^B) An inference 

(C) A law 

(D) A model 

This is a Nature of Science — Scientific — Knows exercise that is 
appropriate forages 13 and 17, 
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APPENDIX C 



Participants in die Development 

of the 1985^ National Assessment of Science 

The National Assessment appreciates the efforts of all the indi\1duals 
who contributed to the development of the :985-86 science ast esisment. 
Many people, including unix'ersit^ professoi^, research scientists, ch-xss- 
room teacherSr schrol administrators and curriculum specialists, as 
well as parents and other interested laypersons, participated inre\ieu'- 
ing successive drafts of these objectives. In addition, riore than 30 
classroom teachers across the countiy wrote exercises for Ine assess- 
ment. NAEP could not have dex'eloped these objectives and the assess- 
menf based on them without the substanti li involvement of tnese 
people. 

Special thanks arc due to the members orthe Science Learning: Area 
Committee who develojjed the framework and specifications for tne 
assessment, were responsix'e to the seiics of revifin\s, and spent long 
hours rpxiewing and revidng exercises. Assisting the;':i were Richard 
DeVore and Hessy Taft, science examiners at Educational Testing Ser- 
vice, and Marion Epstein, science coordinator for N.AER 

The National Assessment extends its deep appreciation to all partic- 
ipants. 

&ience Learning Area Committee 

Audrey Champagne, American Association for the Advancement 

of Science, Washington, DC 
George Kieffer, University of Illinois, Urbana, IL 
Nuria Rodriguez, Bev'erly Hills High School Beverly Hills, CA 
Calvin VanderWerf, University of Florida, Gainesville, bL 
Wayne Welch, University of Minnesota, Minneapolis, MN 

Science Consultants 

Don Ahshapanek, Haskell Indian Junior College, Lawrence, KS 

Dale R Baker, University of Utah, Salt Lake City, UT 

Paul Bamberg, Harvard University, Cambridge, MA 

Ga'? Baixfcio, Board of Education, South Brunswick, NJ 

Ron Barnes, OfiBce of Science, Baltimore County School District, 

BaltiTOre, MD 
William E. Barstow, University of Georgia, Athens, GA 




Unda Behrens, Perrv' Hall Middle School. Baltimore, MD 

Jack Bouma. Pikes\ille Middle School. Baltimore. MD 

Marilyn Bra\'eman. American Jewish Committee. \'e\v York. M' 

Linda Broach, Mountainbrook Jr High School, Birmingham, AL 

John R. Broun, Jr., Trustee, Kean College of NJ„ Short Hills, KJ 

William S. Dougall, I^eside School, Seattle, VVA 

Kenneth VV. Dowling, V\lsconsin Department of Public Instruction, 
Madison. V\l 

Beulah Durr, Nottingham High School, Syracuse, KY 

Vera King Fairis, Ri.^hard Stockton State College, Pomona, KJ 

Louis Finsand, Malcolm Price Laboratory School. University of 

Northern Iowa. Cedar Falls, lA 
Joseph M. Flynn, Citizen s Council for Ohio Schools, Cleveland, OH 
.Anthony Galitsis, N.V.C. Board of Education, Brooklyn, NY 
Roy X Gallant, University of Southern Maine, Portland, ME 
Beverly German, Shady -pring Elementary School, Baltimore, MD 
Been Gibb, Brookline High School, Brookline, MA 
Dennis Gray, Council for Basic Education, Washington, DC 
Martha Green, Florida Department of-Educ^tion, Tallahassee, FL 
Laura Hallou'eU, Wellesle^ High School, VVellesley, MA 
John Harkness, VVausau West High School, Wausau, WI 
Charles J. Hemekivvay, St. Paul's Episcopal School, New Orleans, LA 
Dale T. Hesser, North SyracLise School District, North Syracuse, NY 
Vincent Ilollis, Howard University, Washington, DC 
Ann C. Howe, North Carolina State University, Raleigh, NC 
Cindy Hrebar, Jefferson County Snhool District, Lakewood, CO 
Ken Indek, Uni\«rsity of Illinois, Champaign, IL 
Bernard H. Johnson, Central State University, VMlberforce, OH 
Russ Jones, Sussex Elementary School, Baltimore, MD 
Maryanne Kalin, Fiancis W. Parker School. Chicago, IL 
James Kelly, Malcolm Price Laboratory School Uni\'ersitv of Northern 
Iowa, Cedar Falls, lA 

L^^opold E. Klopfer, University of Pittsburgh, Pittsburgh, PA 
Sylvia Kramer, Women's Action Alliance, New York. NY 
Karl Kranz, National Zoo, Washington, DC 
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Charles Kuzminski, Hopewell \'alley Regional School District, 
Pennington, \J 

Terrv' Kuan, Houghton-Mifflin Reference Di\ision, Boston, MA 

Jeanne Liu, South Carolina Department of Education, Columbia, SC 

Ste\'en Maltese, Charlesmont Elementary' School, Baltimore, MD 

Phyllis Marcuccio. National Science Teachers Association, Washington , 
DC 

George F. Matthias, Croton-Harmon Senior High School, Croton-on- 
Hudson, NT 

Alan J. McCormick, Laramie, \\y 

John McGeehee, Rolling Hills High School, Rolling Hills Estates, CA 

Thomas McGuire, Briarcliff High School, Briarcliff Manor, NT 

Robert McNeesh, Baltimore Count\' Public Schools, Towson. MD 

Kenneth Mechling, Clarion Univei^ity, Clarion, PA 

James Mecklenburger, National School Boards Association. Alexandria, 
\A 

Ida M. Medlem, Bellaire High School, Bellaire, TX 
Suzanne Mittenthal, Unix'ersity of Illinois, Urbana, IL 
Pat Morris, University of Illinois, Champaign, IL 
Patsy Mueller, Highland Park High School, Highland Park, IL 
John Murphy, Board of Education, Howard County' Public School 
System, MD 

Joseph Novak, Cornell UnK'ersity, Ithaca, NT 

Unda Parker, Department of Education, Tallahassee. FL 

George Patrinicola, Loch Raven Senior High School, Baltimore, MD 

Nadine Peterson, Oak Park and River Forest High School, Oak Park, IL 

Michael D. Pibum, Salt Lake City, UT 

Frank Quagliano, Macintosh Middle School, Sarasota, FL 

Senta Raizen, National Academy of Science, Washington, DC 

Thomas R. Richardson, University School of Milwaukee, Milwaukee, v\1 

Joseph Riley, Michigan Department of Education, Lansing, MI 

David Robinson, Albany State College, Albany, GA 

James T. Robinson, Boulder Valley Schools, Boulder, CO 

Eloy Rodriguez, University of California, Irvine, CA 

Maiy Budd Rowe, University of Florida, Gainesville, FL 

Loren E. Saitchez, Upland School District, Upland, GA 
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Walter Scheider. Huron High School. Asm /\rl)or. MI 

B>Ton M, Shinn, McClure Jr. High School. U'uslorn Springs. IL 

Robert Sigda, National Science Teachers Association. Di\ Hills. W 

Mar>' Lou Simon, South Brunswick Schools, Monmouth Junction. \J 

MariKTi Smith, Bev erly Msta School, Be\'erl\' Hills, CA 

Nancy Spaulding. Elmira Free Academy, Elmira, NT 

Frances Stiv ers. Terry' Park High School, Jacksomillc, FL 

Anita Stockton, Perry Hall Senior High School, Baltimore. \ID 

Zack Taylnr. Consultant. Science Education L^nit, Sacramento, CA 

Laigh V'enEtten, Charles Wright Academy, Tacoma, W'A 

Muriel Vaughn, National Black Child Dev elopment Institute. 

Washington, DC 
Henry IValberg, University of Illinois at Chicago. Chicago, IL 
Heniy Walbesser. ITniversity of Maryland, CatonsvilJe, MD 
Millie Waterman, Ohio Education Commission, Mentor, OH 
Gerald F. Ulieeler, Montana State University, Bozenian, MT 
Cheryl Williams, American Association of University Women, 

Washington, DC 

Robert E. Yager, University of Iowa, Iowa City, lA 

Judith Vero, University of Illinois, Champagne, IL 

Lawrence J. Zambrowski, Churchill Jr. High School East Brunswick, 
NJ 

Veronica Zepeda, Arizona State Department of Education, Phoenix, AZ 
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